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Computer-assisted instruction was utilized in seven separate programs at 
Stanford involving children. In the Brentwood Mathematics program, multivariate data 
analysis for 73 first graders led to identification of factors affecting performance on 
mathematical problems. In the read'ng program for first and fourth graders, progress 
was made in curriculum development, and studenf behavior was observed and 
recorded. Extensive computer time was recorded for the dnU-and-practice 
mathematics program for elementary students in four states, and plans were made to 
expand the program. Performance data for the 170 students in the tutorial logic and 
algebra program were analyzed, and better student dialogues with the machine were 
planned Several changes were instituted in the dial-a-drill program for 14 students. 
The elementary Russian program continued, and the spelling program to develop 
optimal methods for individualized, computer-based spelling instruction generated data 
for the 65 children involved. A series of hardware problems plagued the Stanford 
PDP-1 system and the Stanford-Brentwood system, but software operations were 
very stable. (RS) 
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I. Major Activities of the Reporting Period 



A. Brentwood Mathematics Program 



1. Student Use of Laboratory and Analysis of Results 

Enrollment , Of the 72 children who began the quarter, 3 moved. During the quarter, 
7 children enrolled and 3 of them were determined by their classroom teacher to be 
insufficiently mature to work on-line. This made a total of 73 children working on-line 
at the end of the quarter. 

Student progress . A general notion of the children's rate of progress through the 
programmed curriculum can be seen in Table 1 which shows the number of children who 
finished a given book during a particular week. 

Whereas the spread of the children at the end of the preceding quarter was from 
Book 6 through Book 19? at the end of this quarter the spread was from Book 11 through 



Lesson failures . So far, only the first 10 books have been completed by every chi3.d. 
The lesson failures for Books 1-5 were summarized in the report for the preceding 
quarter. The lesson failures for Books 6-10 are summarized in Table 2. 

Student achievement . Tables 1 and 2 give general ideas about some phases of the 
children's progress, Another indicator is the proportion of the problems to which 
students respond correctly. Table 3 shows the number of children whose achievement for 
the week falls within the indicated range of percentage correct. 

Grou P sign- on . Early in this quarter a new sign-on program, which allows a signal 
command to be typed for each group resulting in the automatic sign-on of every child in 
the group, was written and put into use. This eliminates the individual signing on of“ 
each child saving from one to three minutes before each group, and frees the person who 
formerly typed the individual sign-ons so that one less person is needed to prepare for 
a new group. 

Classroom a ctivities . The main topics studied during the quarter were telling time 
to the minute, the calendar, linear measure, and an introduction to graphing. 

Throughout all thesa activities there has been an emphasis on manipulative experiences, 
having the children relate the topics to their own lives, verbalizing the mathematical 
ideas inherent in the study of these topics, and writing mathematical statements to express 
some of the ideas they have verbalized. 

2. Curriculum Development 

Plans for a revision of the second-grade mathematics curriculum have been completed. 
Since the major fault of this year's operation has been an intolerably long system-respons 
time, the entire curriculum will be completely recoded in an effort to reduce response 
time. Other minor changes in coding will be made as the recoding is done. A complete 
list of coding changes follows. 
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TABLE 







Lessons Failed in Books 6 - 1C, Brentwood Mathematics 



Lesson 



C 

D 

E 

F 

G 

H 

J 

K 

L 

M 

R 

S 

T 

IT 

V 

A 

C 

E 

F 

H 

I 

J 

K 

L 

M 

N 

R 

S 



Description 


Number of 
Failures 


finding value of one dime or of n pennies 


2 


counting from 10^ - 19 i 


4 


reflections about the vertical axis and 
rotations of congruent figures 


2 


adding 10 + n 


8 


choosing correct coins to buy pictured 
object 


19 


adding 10 + n 


5 


three addends, sum less than 10 


5 


subtraction less than 10 


27 


counting money 


3 


review of more, less 


15 


first, second, third, last 


4 


three addends, sum less than 10 


21 


10 + n 


6 


introduction to yes-no multiple -choice 
format 


2 


review equal sets 


5 


review of sums less than 10 


9 


sums to 11 


17 


distinguishing between "+" and " 


l6 


sums to 11 


8 


subtraction from 10 or less 


8 


sums to 12 


35 


review of equal sets 


3 


union of sets without symbol 


4 


union of sets introducing "(J " 


22 


sums to 8 - 12 


4 


subtraction from 10 or less, story 
problems 


5 


subtraction 


13 


sums to 12 by counting from n 


24 



V 



4 

A Jj 



k 



TABLE 2 (cont'd) 



ERIC 



Book 


t 

Lesson 


Description 


Number of 
Failures 


7 


U 


union of three sets 


11 




V 


union of two or three sets 


5 


8 




sums to 13 


6 




! ?, 


subtraction from 10 or less 


Ik 




C 


sums to 11, 12, 13 


9 




D 

. 


recognition of equations child hears read 


Ik 


J 

F 


adding 0 to k - 9 


2 


> G 


review more, less 


1 




i H 


adding 0 - k to 8 and 9 


k 




1 


introduction to similar figures 


1 




J 


rotations of similar figures 


5 




L 


10 + n in columns 


8 




M 


review counting money to 19^ 


10 




! N 


sums 10 - 13 


3 




R 


recognition of equations child hears read 


13 




! s 


sums to 11, 12, 13 


l6 


T 


review equal sets 


l 




j u 


review union of 2 or 3 sets 


2 




j V 


sums to 11, 12, 13 


7 


i 


1 w 


recognition of boch addition and subtrac- 
tion equations child hears read 


9 




X 


writing an addition equation to match 
a simple picture story 


lb 


a 


A 


conserving number 


9 




c 


relating m+n=p, p - m = n, and 
p - n = m 


6 


1 •) 

A 


review more, less 


6 


X 

1 


E 


subtraction from 10 or less 


3 




F 


introduction to counting marks on the scope 


6 




J 


practice subtraction from 10 or less 


9 




K 


relating addition and subtraction 


7 




L 


review equal sets 


k 




M 


finding different ways to make the same 
set 


5 




N 


practice subtraction from 10 or less 


15 


. j-.CfV 7 *-’v ■■■.-- . 
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TABLE 2 (cont'd) 




Description 


Number of 
Failures 


sums to 11, 12, 13 


15 


review rotation of similar figures 


1 


sums to 11, 12, 13 


7 


practice subtraction from 10 or less 


10 


introduction to open and closed figures 


10 


writing a subtraction equation to match 
a picture story 


28 


preparation for writing subtraction 
equations without clues 


8 


writing subtraction equations 


b 


practice subtraction from 10 or less, 
tallies displayed 


6 


commutativity of sums 11 - 13 


3 


half 

practice subtraction from 10 or less 


3 

< 

5 


open figures 


2 


sums to 11, 12, 13, column format 


26 . 


review identifying circles and line 
segments 


1 


column subtraction from 10 or less 


17 


half 


5 


sums of three numbers to 11, 12, 13 


23 


introduction of word ft minus" with 
problems either in vertical or horizontal 
format 


31 


balancing set equations 


8 


review rotation of similar figures 


5 



Coding changes . 

a. Typing responses. All problems calling for a typed response will be recoded to 
conform to the changes made in the latter half of this year’s curriculum. The major 
effect of this change will be to increase system-response time. The HELP and ERASE 
functions must be slightly modified but will not be significantly more difficult for the 
student. Also the displays must use character-size rather than graphic-size numerals. 

b. Time-out. Almost all time-out routines in this year's material have occurred 
after 30 seconds. In order to allow more flexibility, the time allowance will not be 
coded but will be controlled by proctors using the system’s LATENCY command. The 
proctors will then be able to use different time allowances for different groups of 
children or on different days. In special cases where the time-out is now set to 
correspond to particular curriculum requirements (either longer or shorter than the 
standard 30 seconds), the time allowance will be coded and will override the system 
LATENCY. 

c. HELP. In the coding for 1967-68, two uses of the HELP routine by the student 
causes the answer to be displayed. In the revision this branching command will be 
deleted, so that repeated uses of the HELP routine produce an identical response from 
the system. 

d. Incorrect responses. The present coding provides for the display of the correct 
answer after three incorrect responses; in the revision this branch command will be 
conditional upon two incorrect responses. 

e. Mid-lesson branch. A large number of lessons in the present curriculum allow 
for a progress check at the mid-point; students who are clearly failing to meet criterion 
for the lesson are branched immediately to remedial work. In the revision, all lessons 
(except stories and games) will have mil-lesson branch points. 

f . End-of-'lesson indicator. About half of the lessons for 1967-68 include a short 
display to indicate the end of the lesson. These displays, containing phrases like 
"End of Lesson," serve as indications of progress to the student. In the x'evision, all 
lessons will be terminated in this manner. 

g. Deletion of lessons. A few lessons which have proved to be unsatisfactorily 
written will be deleted in the revision. Also, some lessons which seem to be unnecessary 
will be deleted. 

h. Acceleration branching. In order to make more provision for individual differences 
about one-third of the lessons which have been mandatory for all students will contain 
provisional branching instruction to allow brighter students to bypass the lesson. The 
design of the criteria for the acceleration branching has not yet been completed, since it 
is desirable to base the deci sions on data analysis which will not be completed until all 
data are collected for the current school year. 
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Extension of curriculum * Since the accelerated branching (discussed in the preceding 
paragraph) will allow some students to move through the curriculum much more rapidly than 
was the case during this year, additional material must be prepared in order to provide 
a sufficient number of lessons for the more able students. At present the plans are to 
prepare 10 more books of lessons; if time permits and if the performance of the students 
at the end of this year indicates a need, several more books will be prepared. 

3. Production 

The major effort during this reporting period has been, as usual, the continuing 
production of programmed lessons. As of the end of this quarter the production progress 
report shows the following: 

Phase of production Work completed through book 

Lesson writing 65 

Recording lj-8 

Art work 

Coding lj-6 

Debugging V7 

No significant changes in production procedures have been made. 

Data Analysis 

'Individual models . The analysis of data for individual students in the first-grade 
mathematics program at Brentwood has been completed. The purpose of the analysis was to 
determine whether certain factors could predict a student's performance on a given set of 
lessons. Unlike the factors based on problem structure used in the ’’structural analysis,’’ 
the factors used in this analysis were measures of prior performance of the individual. 

Two measures of performance were involved: the proportion of problems which the student 

answered correctly on the first response, and the student's average latency to the first 
response on correct problems, 

I 

Standard regression models were used to obtain the predictions. Two theories were 
involved in choosing the specific models. One theory was that the best indicator of a 
student's future performance is his most recent past performance. This line of reasoning 
led to the "temporal" models in which the prediction of an individual's performance in a 
given block of lessons was based on his performance in the immediately preceding blocks 
of lessons. The other theory was that performance depends on the degree of understanding 
of the information (terms, symbols, concepts, etc.) necessary to complete the new task. 
This idea led to the "conceptual" models in which the prediction of an individual's 
performance on a given set of lessons was based on his performance on previous lessons 
which exemplified the same concept. 
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Since the difference in performance for a given individual at two points in the 
curriculum is a function of both the "normal" variability of the individual and the 
particular curriculum points chosen, ths parameters for the various models were estimated 
in two ways. The first method, estimation of group parameters, accounts for differences 
in performance as a function of the curriculum points examined. In this case, one set of 
parameters was estimated for each set of lessons with the estimation based on the perfor- 
mance of all students on the preceding set of lessons appropriate to the model under 
consideration. Thus to predict an individual’s performance, a different set of parameters 
was used for each block of lessons; for a given block, the same set of parameters was used 
for all students. 

The second method, estimation of individual parameters, accounts for changes in 
performance specific to an individual. In this case, one set of parameters was estimated 
for each student based on his performance on all lessons. Thus to predict an individual’s 
performance, a set of parameters was used which was unique to that student but was the 
same for all blocks of lessons; for a given block, a different set of parameters was used 
for each student. The individual estimation technique was modified for some models to 
include, to some extent, differences in curriculum. Individual parameters for these 
models were estimated more than once, each based on a different segment of the curriculum, 
e.g., each set of four lessons. Thus, the set of parameters used to predict an individual 1 
performance was unique to the individual and to the segment of the curriculum under 
consideration. 

2 

Comparisons of the various models were based on a total X value when proportion 

2 

correct was the dependent variable and on the S value when latency was the dependent 
variable (Suppes, Hyman, and Jerman, 1967). For proportion correct, the conceptual models 
predicted individual performance better than the temporal models with both the group and 
the individual parameter estimation techniques. Thus, a student's performance on a given 
topic is more dependent upon his past performance on that topic than upon his more recent 
performance on a different topic. For latency data, there were no differences between 
the temporal and conceptual models. 

Again, considering data in terms of proportion correct for both the temporal and 
conceptual models, group parameters gave better predictions than the individual parameters. 
For the temporal models, the modified individual estimation technique yielded predictions 
which were better than the individual parameters based on all the student data, but were 
not as accurate as the group parameter predictions. For the latency data, all models 
based on group parameters were better than the models estimated by individual parameters. 

Regression analyses of group data on individual items , Five concepts in the first- 
grade mathematics curriculum were completed. Variables were defined to reflect problem 
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structure and to predict proportion correct and success latency. The results have been 
tabulated and will be presented in a forthcoming report. The multiple- correlation 
coefficients for proportion correct ranged from .50 for counting to for subtraction, 
while those for success latency ranged from .67 for geometry to .87 for sets. 

Following are examples of variables and the results obtained for the regressions# In 
predicting proportion correct for addition problems, the following variables were • 
defined: 



X _ - number of symbols on the cathode-ray tube; 

+ 1 

X l0 - the largest addend; 

. 

X^ - the smallest addend; 

X^ - the sum; 

X c - the value of the smallest incorrect response alternative divided by the 
+5 

difference in value between the smallest incorrect response alternative 
and the correct choice; 

X +6 - two if the blank is to the left of the equal sign and to the left of the 
plus sign. One if the blank is to the left of the equal sign and to the 
right of the plus sign; 

X +1 ^ - one if a typed response is required in a problem. 

In predicting success latency for subtraction problems, the following variables were 
defined: 



X ^ - the diminuend; 

X 2 - the subtrahend; 

X ^ " the difference; 

X r - one if counting marks were displayed, but the number equal to the subtrahend 
were not crossed out or no counting marks were displayed; 

X _ - one if no counting marks were displayed; 

X £ - the magnitude of the inverse of the number of times which a specific problem 
had been given up to that point in the curriculum; 

X rj - one if a problem had a vertical format. 

The regression coefficients and multiple- correlation coefficient for the addition and 
the subtraction blocks are shown in Table k . The regression analysis was successful in 
predicting proportion correct for the subtraction problems; less information was 
obtained for the addition problems. 
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TABLE ft 

Regression Coefficients for Group Probability Analysis, Brentwood Mathematics 



Concept 


Number of 
Problems 


Constant 


x .i 


X .2 


x .3 X A 


X q 

• s 


X .6 X . T 


R 


Addition 


l6l 


-1,18 


-.01* 


.11* 


.16* -.06* 


.22* 


.8ft -,63 


.51 


Subtraction 


6ft 


5 .28 


-.63* 


• 93 


, 9 ft - 1.51 


3.26 


-2.58 -.80 


.82 



*t score for regression coefficient < 2.00 



As a result of the analyses of the first-grade mathematics data, a number of the 
factors which affect performance on mathematics problems were identified. These results 
are now being utilized in a similar analysis of the second-grade mathematics curriculum. 

' ' , B. ’Brentwood ' Reading Program 

1 . Curriculum Development 

Levels VII and VIII of the reading curriculum were completed. A revised comprehen- 
sion section which can be implemented at any date has been planned for Level VIII. 
Supplementary materials and the Teacher’s Manual for Levels II and III have been 
distributed to the Brentwood teachers. 

2 . Coding 

Every lesson through Level VII has been coded, keypunched, and has had at least one 
c&rd assembly. Levels IV and V have been ready for student use since January. Almost 
half of the detecting and correcting has been done for Levels VI and VII to prepare them 
for student use. 

3. Student Use of Terminals 

Enrollment and progress . At the end of the reporting period , 80 first-grade students 
and 7 remedial fourth-grade students, who began work on March 13 , were working on the 
reading curriculum. Table 5 indicates the number of first-grade students in each lesson 
at the end of the thirteenth through the twenty- fifth weeks. Behavior and progress of 
the fourth graders will be described in the next quarterly report. 

The underlined figure in each column represents the maximum, progress by the fastest 
student during that same week last year. By the end of the thirteenth week, this year’s 
fastest student had completed 21 lessons more than last year's fastest student; by the 
end of the twenty- fifth week, he had completed 23 lessons more. The increasing spread 
of the students over the lesson material indicates that at least some of the individual 
differences in the learning characteristics of the student population are being 
accommodated in the curriculum. Table 5 also indicates two factors affecting the rate 
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TABLE 5 

Weekly Distribution of First-Grade Students in Each Lesson 

(January 2 - March 29) 

Brentwood Beading 
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TABLE 5 (cont’d) 
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of progress. First, there has been considerable demographic movement in the student 
population 5 accordingly, none of the children in the early lessons of Level X represent 
students who began work in September 1967 . Second, the table reflects the increasing 
complexity of the lessons in Levels III and IV. The children begin work on compound and 
polysyllabic words in Level III and begin reading short stories to themselves in Level IV. 
Thus, the time required to complete a lesson is considerably longer. 

Student terminal behavior . During this reporting period, graduate students in the 
Experienced Teacher Fellowship Program have observed and recorded student behavior and 
attitudes. These observations were made two times during the school year for each student* 
Table 6 indicates the results of children’s behavior on the first set of observations whil< 
working at the CAI terminals. The results of the second set of observations will be 
reported in the next quarterly report. Eight basic categories of behavior were outlined. 
Each child was observed for 5 minutes at the beginning, in the middle, and at the end of 
a period. During each 5~ m i nu -f e period, the observer checked the type of behavior 
displayed every 15 seconds. Thus, for the entire sample of 73 students, any specified 
behavior could be observed a maximum of 20 times during the 5 -minute period for a given 
student. Variable 1 (looking at scope or projector) would represent a desirable behavior, 
while Variables 2-8 would be undesirable. The table indicates that Variable 1 was in 
predominance with a mean of 17-2 out of a possible 20 for the entire sample. The columns 
headed "Maximu m 1 * and "Minimum" indicate that although there was at least one student who 
exhibited the desirable behavior only eight times in the observation period, there were 
several children who exhibited the desirable behavior a near maximum number of times 
(i.e., 20 times). The means for Variables 2-8 indicate that a minimal amount of 
undesirable behavior was found. Often the child displayed these forms of behavior while 
the system was functioning at a slower than normal rate, 

k . Weekly Report 

A weekly report was generated to provide information about student progress to the 
teachers and proctors. The report will also assist in identifying learning difficulties 
experienced by the students in sufficient detail so corrective measures can be determined 
and implemented. The information is derived from the recorded responses of the students. 
These recorded responses include the following: 'date; relative response time; student 

identification number; identification of the problem to which the student responded; the 
actual response coordinates; the nature of the response, i.e., correct, wrong, overtime, 
unidentifiable; latency in making the response; the records of positions of various 
switches and the contents of various counters used in curriculum sequencing and branching 
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The student’s rate of progress through the curriculum is dependent on four different 
branching sequences: (a) any repetition within a specific problem type using optimization 

procedures; (b) repetition of problem types previously passed to obtain additional 
practice to pass successive problem types; (c) use of Additional remedial material to 
compensate for apparent deficiencies in student experience; and (d) the branching of the 
student to "off-line" tutorial help given by a teacher. A proctor branches the student 
to off-line remedial help when the CAI system indicates that the student has been working 

on a single block of problems for mofe than two days. The off-line remedial help lasts 

a minimum of one full session and is continued on sequential days at the discretion of 
the teacher. j 

The sequence of problem types to which the student is exposed each day within any 
one lesson, and within a week, records the path a 'student follows through the curriculum. 
The.'.problem types begun each day are printed and slashes are inserted when the date 
changes. Table 7 shows a typical sequence of problem types. 

At the beginning of each daily session the student is returned to the initial problem 

of the type he was doing when the previous session was terminated. Therefore, the same 

problem type commonly occurs twice in sequence--before and after a change in date. The 
number of problem types encountered each day is noted, and the sum of the daily counts for 
the lesson or for the week is recorded as shown in Table 7 . 

By providing information about the nature of student responses, the-. weekly report is 
useful in attempting to answer the following general questions: • 

1. Does the student understand the types of responses expected of him? 

2. Is the student attending to the task presented him? 

3. Is the student having visual-muscular coordination problems while attempting to 
respond? 

Student responses are catalogued into one of four categories: correct responses, 

anticipated wrong responses, unanticipated or unknown responses, and overtime responses. 
The fourth category describes responses made after -the time preassigne'd for the problem 
type . 

The distribution of both overtime responses and unknown answer responses may suggest 
different types of difficulties. For example, if a student consistently makes strings 
of unknown responses, he may be having difficulty either with muscular coordination or 
in understanding directions. Similarly, extensive strings of overtime responses would 
suggest that the student is not attending to the task presented him or, again, that he 
does not understand the instructions’. Each week the proctor's receive distributions of 
overtime and unknown responses for each lesson within the week. The distribution of 
overtime And unknown responses is also sorted for three of .the maj of blocks within the 
curriculum (word list, matrix, and comprehension) as shown in Table 8. 
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The optimization routine used in some of the major blocks in the curriculum provides 
a method by which a student is corrected and repeats each of the problems missed until he 
has correctly responded to each problem without assistance. To determine whether or not 
this procedure is facilitating learning, the ratio of the number of original problems 
missed to the total number of times the student had to attempt the problem is computed. 

If this ratio is 1.00, the student learned with one correction on each problem. Values 
less than 1.00 show that, on the average, the student requires more corrections for each 
original problem missed, e.g., .5 indicates two trials per problem. This ratio is 
computed, printed, and labeled the coefficient of interaction. 

In addition to the coefficient of interaction, the percentage correct on the first 
unassisted trial for each problem within a problem type is computed and printed. This 
computation does not consider any responses made while the student was being assisted 
through the correction procedure. Two additional values are computed and printed: 

(a) the number of problems in the problem type; and (b) the overall proportion correct 
on the unassisted trials. Table 9 shows these computations on a weekly report for a 
typical student. 

5 • Data Analysis 

Data from the daily reports has been assembled to show how the amount of time spent 
on the computer relates to a student's progress through the curriculum. A student's 

l 

progress is measured by the number of problem types completed, e.g., screening test, 
word block, matrix block, sentence initiators, compound words, contractions, etc. A 
measure of problem types completed gives a more accurate evaluation of a student's rate 
of progress as the problem types cover more nearly equal units of curriculum than do the 
lesson?. A single lesson may contain from k to 20 different problem types (PT's). A 
problem type is counted only once. Thus, when a student repeats any part of the 
curriculum, those repeated problem types are not added to his total of problem types 
completed. Only main-line problem types are counted; remedial problem types are not 
considered . 

From these daily reports a weekly summary has been compiled providing the following 
information for each child: (fa') tlp.e number of minutes on the computer during the week; 

("b ) the cumulative time on the computer to date; (tj) the lesson and PT completed at 
the end of each week; (id ) the total PT's completed to date; and ( e) the number of PT's 
completed during the week. 

Figure 1 indicates the progress of three selected students from October 13? 1967 to 
March 15, 1968. N? is the student who has progressed the furthest. Ml has made moderate 
progress, and J1 is one of the students who has shown the least progress. In each case 
the line representing his rate of progress approximates a straight line. There is a 
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Figure 1. Weekly Progress of Three Students from October 13 9 19&7 through 
March 15 , 1968 9 Brentwood Reading 
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noticeable change in the rate of progress (slope) as the student moves into Level II 
(PT l6o). The increase in rate shown by J1 at about 600 minutes probably is explained 
by the practice of proctoring students through the matrix block after they have been 
working on a matrix block for two consecutive days. The figures indicate that student 
rate pf progress during this reporting period has been essentially linear. 

The scatter diagram shown in Figure 2 locates each student by the time he has spent 
on the computer and by his progress through the curriculum. The diagonal lines from 
the origin indicate progress rates in minutes per problem type. Eight Students 
progressed at a rate faster than 3 minutes per problem type. The median rate is about 
6 minutes per problem type. About 20 per cent of the pupils progress at a rate slower 
than 10 minutes per problem type. 

Figure 3 indicates the average time efficiency of the system. In computing the 
average time ’.pent on the computer per day, the number of minutes spent on the computer 
each session is totalled for the week and divided by the number of student days. A 
student day is considered to be two minutes or more of work. Days when the- student is 
off-line for remedial help, and days when machine failure results in no time on the 
computer, are not counted. Figure 3 indicates the time efficiency of the system to be 
about 70 per cent, with a range from 56 to 80 per cent. Time lost is due to machine 
failure during a session, lesson turn-around time, and interruptions for discipline or 
explanation. 

C. Drill - and - practice Mathematics Program 
1. Use of the System in Schools 

The number of students given daily lessons remained fairly constant in spite of the 
addition of three new elementary schools in Kentucky. The total number of students 
given lessons each day at each school is shown in Table 10. The formal starting date 
of the new elementary schools in Kentucky is also indicated. Students "signed on" the 
system at least 86,192 times, which is the total number of student entries in Table 10 . 

A workshop for teachers and administrators was held at Morehead State University, 
Morehead, Kentucky, February 1-3* The program of the workshop emphasized (a) behavioral 
definitions of instructional objectives; (b) projection of the year's mathematics work 
in detail and selection of appropriate drill-and-practice lessons to supplement the 
planned course of instruction; and (c) practice on instructional terminals as students. 

In addition, participants in the workshop were given instruction on simple maintenance 
procedures for the instructional terminals. 

Table 11 shows the actual number of students enrolled in the program as of March 29 
at each grade level at each school. The numbers represent ' students taking lessons at 
a given grade level, regardless of their actual grade placement in school with the 
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Figure 2. Distribution of Students by Lesson Material and Time on Computer as of March 15, 1968, 
Brentwood Reading 
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Figure 3« Average Time on Computer per Student for each 
Session , Brentwood Reading 



TABLE 10 

Number of Students Given Daily Lessons at Each School (including Logic Students) 
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exception of Peter Burnett, Garden Oaks, and Oak Knoll Junior High Schools. Even though 
the students are officially seventh, eighth, and ninth graders, they are working on 
lessons at the third-, fourth-, and fifth-grade levels. 

Students in the Job Corps Center in Clinton, Iowa are high-school age, and older. 

These girls are attempting to learn a trade and to earn a high- school diploma at the same 
time. As shown in Table 11, there is considerable variation ip their ability as indicated 
by the grade level to which they have been assigned. The majority of the students are 
working at the fourth-grade level. 

The number of lessons given each day is graphed in Figure 4. Even though the data 
for three days were not available, the increase in the total number of arithmetic 
lessons, tests, reviews, and logic lessons over that of last quarter (86,630) is sizable. 
The total number for this reporting period is more than 119,980. 

The percentage of students in California schools who have completed each concept 
block is shown in Table 12. Tables 12 through l4 , respectively, show the percentage of 
students who have completed each concept block in Mississippi and Kentucky schools. The 
percentage for all schools is shown in Table 15 . 

The actual number of tests or lessons given on the last day of this reporting period 
is shown in Table l6. The distribution of students over concept blocks at each grade 
level is shown. This table emphasizes the demands for flexibility imposed on a system 
by a program which stresses individualization. Nearly every concept block at each grade 
level was sampled by some student during the day. Considering that the first 2b blocks 
at each grade level contain the planned content, this table shows that on March 29, more 
than 86 per cent of the total curriculum data base was sampled. The ability to have 
available for use the entire program at each grade level, together with a rapid system 
response to each student 1 s input, has contributed significantly to the success of -the 
program. When either of these two components are lacking, the system is less satisfactory 
from the teacher 1 s point of view, as well as our own. 

Table 17 presents the number of reviews sampled on March 29. As would be expected, 
the number of review blocks sampled is less than that of the number lessons. It is 
still clear from this table that it is necessary to have every review block available, 
since it is nearly impossible for a person to predict what will be needed on any given 
day. 

2. Curriculum Revision 

Revisions of the drill-and-practice curriculum were completed during this reporting 
period. Pretests and posttests for each block were revised to make them as nearly 
parallel as possible. Revisiop of the upper levels (.Levels ij- and 5) of* each block to 
increase uniform difficulty was also completed. 
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TABLE 12 

Percentage of Students Who Have Completed Each Concept Block 
in California Schools as of March 29, 1968 
Drill-and-Practice Mathematics 



Grade 



Block 


1 


2 


__3 - - 


4 


5 


6 


1 


56 


85 


100 


98 


65 


99 


2 


56 


54 


99 


97 


68 


97 


3 


56 


52 


98 


96 


64 


92 


4 


56 


49 


96 


92 


94 


88 


5 


54 


49 


95 


92 


60 


85 


6 


51 


47 


93 


51 


59 


83 


7 


48 


46 


81 


6 


74 


79 


8 


42 


44 


67 


79 


72 


78 


9 


36 


39 


31' 


8 


75 


35 


10 


3 1 


50 


57 


74 


70 


27 


11 


27 


26 


20 


72 


23 ’ 


44 


12 


23 


25 


57 


57 


56 


25 


13 


16 


20 


49 


49 


31 


15 


14 


10 


10 


4 


51 


6 


35 


15 


0 


0 


13 


10 


3 


2 


16 


0 


0 


14 


2 


7 


0 


17 


0 


0 


1 


0 


2 


0 


18 


0 


0 


4 


12 


1 


0 


19 


0 


0 


0 


0 


1 


0 


20 


0 


0 


0 


0 


0 


0 


21 


0 


0 


2 


0 


0 


0 


22 


0 


1 


0 


0 


2 


1 


23 


0 


0 


0 


0 


0 


0 


24 


0 


0 


0 


0 


32 


0 • 


25 


0 


0 


0 


0 


0 


0 


26 


0 


0 


0 


0 


0 


! 0 


27 


0 


0 


0 


0 


9 


i Q 


28 


0 


0 


0 


0 


65 


0 


29 


0 


0 


0 


0 


0 


0 


30 


0 


0 


0 


0 


0 


0 



0 
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TABLE 13 

Percentage of Students Who Have Completed Each Concept Block 
in Mississippi Schools as of March 29 > 1968 
Drill-and-Practice Mathematics 



Grade 



Block 


1 


2 


3 


4 


5 


6 


1 


100 


68 


100 


91 


98 


98 


2 


100 


100 


100 


88 


98 


98 


3 


98 


97 


96 


55 


58 


98 


4 


96 


95 


96 


14 


97 


98 


5 


92 


97 


96 


76 


97 


77 


6 


93 


97 


96 


73 


94 


63 


7 


92 


95 


93 


0 


82 


86 


8 


90 


90 


94 


63 


4o 


52 


9 


84 


86 


90 


44 ! 


94 


48 


10 


78 


83 


90 


47 


44 • 


24 


11 


6l 


79 


64 


25 


56 


70 


12 


49 


74 


0 


0 


43 


18 


13 


39 


6o 


0 


36 


12 


18 


14 


; 29 


37 


0 


28 


2 


57 


15 


25 


0 


0 


4o 


0 


15 


16 


18 


0 


64 


48 


0 


16 


17 


13 


0 


0 


19 


20 


22 


18 


14 


0 


0 


7 


0 


0 


19 


12 


0 


64 


0 


0 


0 


20 


1 


; 

1 0 


0 


0 


0 


0 


21 


0 


0 


0 


0 


3 


0 


22 


1 ° 


0 


0 


19 


0 


0 


23 


0 


0 


i o 


l 


0 


0 


24 


0 


0 


0 


0 


76 


0 


25 


0 


1 


0 


0 


17 


0 


26 


0 


0 


0 


0 


36 


0 


27 


0 


64 


0 


0 


50 


0 


28 


0 


0 


0 


0 


6 


0 


29 


0 


0 


0 


0 


0 


0 


30 


0 


0 


0 


0 


0 


0 
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TABLE 14 

Percentage of Students Who Have Completed Each Concept Block 
in Kentucky Schools as of March 29> 1968 
, Drill- and-Practice Mathematics 



Block 


1 


2 


3 


4 


..3 


6 


1 


0 


100 


0 


0 


0 


0 


2 


100 


100 


0 


0 


0 


0 


3 


100 


100 


0 


0 


0 


0 

\ 


4 


98 


100 


47 


0 


0 


0 


5 


87 


100 


47 


71 


100 


62 


6 


49 


100 


65 


71 


100 


62 


7 


35 


100 


29 


71 


45 


49 


8 


36 


100 


29 


69 


45 


47 


9 


7 


100 j 


18 


39 


31 


15 


10 


3 


100 1 


j 22 


33 


0 


0 


11 


1 


• i 

95 ! 


i 

1 3 

1 


0 


0 ’ ! 


0 


12 


0 


44 


1 

0 


0 


0 


0 


13 


0 


4l 


0 


0 


0 


0 


14 


0 


41 


0 


0 


0 


0 


15 


0 


41 


0 


0 


0 


0 


16 


0 


40 


0 


0 


0 


0 


17 


' 0 


34 


0 


0 


0 


0 


18 


0 


31 


0 


0 


0 


0 


19 


0 


26 


0 


0 


0 


0 


20 


0 


22 


0 


0 


0 


0 


21 


0 


27 


0 


0 


0 


0 


22 


0 


13 


0 


0 


0 


0 


23 


0 


0 


0 


0 


0 


0 


24 


0 


0 

) 


0 


0 


0 


0 


25 


* 

0 


0 


0 


0 


0 


0 


26 


0 


0 


0 


0 


0 


0 


27 


0 


0 


0 


0 


0 


0 


28 


0 


0 


0 


0 


0 


0 


29 


0 


0 


0 


0 


0 


0 


30 


0 


0 


0 


0 


0 


0 
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TABLE 15 

Percentage of Students Who Have Completed Each Concept Block 
in All Schools as of March 29, 1968 
Drill- and-Practice Mathematics 









Grade 






Block 


1 


2 


-=* 

on 


5 


6 



1 


75 


80 


88 


82 


74 


95 


2 


80 


64 


87 


76 


77 


94 


3 


77 


61 


85 


66 


61 


92 


4 


79 


58 


85 


59 


95 


90 


5 


74 


58 


84 


68 i 
1 


7 r ' 


78 


6 


62 


57 


84 


47 ! 


71 


69 


7 


57 


6l 


67 


17 


72 


79 


8 


57 


59 


64 


60 


55 


59 


9 


4l 


48 


32 


22 : 

I 


72 


40 


10 


38 


59 


48 


50 ; 

1 


48 | 

1 


22 


11 


28 


51 


18 


45 


28 ; 


56 


12 


25 


36 


34 


29 


42 1 

i 


18 


13 


19 


3 1 


28 


27 


19 i 

1 


| 15 


14 


15 i 


1 22 


3 


15 


4 i 

1 


! 41 

t 


15 


1 

9 


9 


8 


l4 


2 


9 


16 


6 


9 ’ 1 


24 


20 


3 


9 


17 


4 


8 


1 


5 


8 


13 


18 


5 


7 


3 


7 


0 


0 


19 


4 


6 


16 


0 


0 


0 


20 


0 


4 


0 


0 


0 


0 


21 


0 


3 


1 


0 


0 


0 


22 


0 


2 


0 


5 


1 


0 


23 


0 


0 


0 


0 


0 


0 


24 


0 


0 


0 


0 


94 


0 


25 


0 


6 


0 


0 


63 


0 


26 


0 


0 


0 


0 


73 


0 


27 


0 


89 


0 


0 


71 


0 


28 


0 


0 


0 


0 


51 


0 


29 


0 


0 


0 


0 


0 


0 


30 


0 


0 


0 


0 


0 


0 
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TABLE 1 6 

Number of Tests or Lessons Per Grade and Concept Given on March 29? 1968 

Drill-and-Practice Mathematics 



Grade 



Block 


1 


2 


3 


4 


5 


6 


1 


5 


11 


18 


10 


3 


10 


2 


0 


2 


9 


1 


8 


0 


3 


l 


3 


l 


0 


20 


1 


4 


2 


8 


3 


21 


3 


1 


5 


15' 


5 


14 


3 


3 


28 


6 


27 


2 


10 


78 | 


| 3 


2 


7 


12 


5 


\J1 

00 


2 


4l 


19 


8 


23 


2 


18 


5 


7 


20 


9 


29 


8 


20 


28 


l6 


42 


10 


25 


6 


13 


6 ! 

1 

l 


! 19 

) 


20 


ll 


13 


17 


54 


19 i 


10 


9 


12 


12 


43 


26 


16 | 


! 21 

1 


31 


13 


9 


10 


23 . 


19 


i 51 

} 


74 


14 


10 


14 


5 


1 


6 


\f\ 

00 


15 


14 


l6 


8 


3 


l 


20 


1 6 


5 


5 


28 


25 


19 


19 


17 


7 


2 


12 


7 

» 


9 


33 


18 


? 


4 


29 


14 


5 


4 


19 


2 


3 


0 


0 


l 


0 


20 


15 


11 


0 


0 


0 


0 


21 


2 


12 


4 


0 


2 


0 


22 


8 


l6 


0 


4 


3 


4 


23 


8 


0 


0 


2 


0 


3 


24 


4 


0 


0 


0 


9 


0 


25 














26 


0 


0 


0 


0 


2 


0 


27 


0 


0 


0 


0 


29 


0 
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TABLE 17 

Number of Reviews Per Grade and Concept Given on March 29 , 1968 

Drill- and- Practice Mathematics 



Block 



Block 


1 


2 


3 


4 


5 


6 


1 


7 


0 


17 


4 


5 


2 


2 


16 


4 


15 


2 


7 


3 


3 


17 


2 


8 


1 


19 


13 


4 


4 


0 


13 


0 


1 


3 


5 


6' 


0 


10 


3 ! 


I ^ 


39 


6 


10 


9 


5 


I 

3 


1 

2 


17 


7 


6 


3 


4 


1 


3 


9 


8 


5 


0 


4 


2 


17 


40 


9 


3 


5 


8 


0 


9 


42 


10 


l 


10 


2 


0 


1 


! 18 

* 


11 


2 


5 


17 


3 


1 

0 ; 

1 


12 


12 


12 


0 


i 0 


0 


• 1 

22 j 


2 




22 


7 i 


1 0 


4 ! 


! 0 1 


8 


14 | 


2 


2 ! 


i 0 


! 1 ! 


i 1 

j 0 


9 


15 | 


0 ! 


1 ! 


0 ! 


1 ^ | 


0 


1 


16 ; 


0 


0 ! 

1 


O ! 


19 i 


| 0 


1 


17 : 


0 


1 ! 

< 


0 1 
1 


2 


1 2 ; 


5 


18 


0 


1 

! 5 


1 

0 i 

1 


0 

1 


0 1 


0 


19 


0 ! 

I 


9 


0 | 

J 


0 i 

1 


0 


0 


20 


0 1 


9 


0 


0 


0 


0 


21 


0 ! 


2 

1 


0 


0 

1 


0 


0 


22 1 

1 


0 i 


0 ! 


0 1 

1 


3 j 


0 j 

1 


0 


23 ; 


0 i 

i 


0 i 


0 ! 


0 ! 


0 


2 


24 | 


0 i 

1 


1 

0 ; 

1 


0 i 


0 1 


7 


0 


25 | 


i 

0 


0 ! 


0 ! 

1 


0 


i 

1 | 


0 


26 ! 

27 

1 

f 


i 

0 


! 

0 i 


1 

0 


0 


i 

i 

1 


0 



0 
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3 * Strands Program 

California students began using addition, subtraction, and multiplication strands in 
place of their daily review lessons early in January. Students in grades 1 through 3 
Were started in addition and subtraction strands. Students in grades 4 and 5 were 
started in multiplication and subtraction strands. The subtraction strand will be 
replaced by the fraction strand as soon as it is ready early in April. Each student 
is given seven problems from each strand each day as a review lesson. 

A description of the equivalence classes of problem types used in each of the first 
four strands is given in Table l8. 

The number of students in each equivalence class in each strand; is in Table 19 •• 

TABLE 19 

Number of Students in Each Equivalence 
Class in Each Strand as of March 29? 1968 
Drill-and-Pr&ctice Mathematics 



♦ 




Equivalence 


class 








- 




Strand 


1 


2 


3 


4 


5 


' 6 


7 


8 


■ 9 


10 


1 


Addition 


20 


32 


3 S' 


35 


44 


51 


l4 


15 


6 


l 


2 


Subtraction 


48 


146 


214 


99 


33 


28 


17 


9 


3 




3 


Multiplication 

* 


24 


104 


148 


63 


l 








• 





The first five ■ equivalence classes of the multiplication strand, which consist of 
problems of the form 

b 

a x b = , a x __ = c, x b = c, and x a , . 

$ 

were established aS the result of student performance on a specially constructed set of 
lessons included as part of the regular drill program. Problems up to 9x9 were rank 
ordered according to probability correct. 
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TABLE 18 

Equivalence Classes of Problem Types in Addition, Subtraction, 

Multiplication, and Fraction Strands 
Prill-and-Practice Mathematics 




TABLE 18 (cont'd) 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Class 



Strand 3 multiplication 



6: 


10 


30 


80 


Class 20 : 


12 


11 


26 




x 6 


x 2 


x 1 




x 6 


x 9 


x 2 


7 : 


100 


200 


500 


Class 21 : 


120 


380 


110 


x 7 


x 6 


x 1 




x 2 


x 1 


x 8 


8: 


30 


50 


90 


Class 22 : 


2 x 606 = 


3 x 102. = 


6 x 201= 




x 4 


X 5 


x 2 


















Class 23 : 


22 


25 


49 


9 : 


200 


4 oo 


900 




xJL 


x 4 


x 2 i 




x 7 


X 3 


x 2 


















Class 24 : 


2 x 12 = 


2 x66 = 


4 x 11 = 


10: 


4 o 


6o 


90 












x 7 


X 3 


x 8 


Class 25 : 


340 


520 


720 












x 3 


x 4 


x 7 


11: 


6oo 


4oo 


500 












x 3 


X 7 


x 9 


Class 26 : 


2 x 904 = 


5 x 402 = 


4 x 505 = 


12: 


6o 


70 


90 


Class 27: 


44 


89 


93 




x 8 


X 9 


x 6 


x 7 


x 5 


x 8 


13 : 


700 


4oo 


900 


Class 28 : 


260 


890 


950 




x 5 


x 8 


x 7 




x 3 


x 5 . 


x 9 


Ik: 


4 o 


70 


90 


Class 29 : 


5 x 608 = 


8x205 = 


9x508 = 




x 30 


x 20 


x 20 












6o 


90 


Class 30 : 


54 


33 


77 


15 : 


30 


x 20 


x 40 


x 30 




x :80 


X 50 


x 80 










6o 


80 


40 


Class 31 : 


46 


85 


95 


16: 


x 4o 


x 70 


x 90 




x 7.0 


x 90 


x 80 
















Class 32 : 


97 


67 


46 


17 : 


200 


500 


700 


x 4 


x 9 


x 8 




x 40 


x 30 


x 70 










18 : 






900 


Class 33 : 


98 


47 


74 


200 


500 


x 30 


x 90 


x 80 




x 30 


x 70 


x 90 












900 


Class 34 : 


890 


48 o 


660 


19 : 


300 


700 


x 4 


x 9 


x 8 




x 60 


x 40 


x 70 











42 

TABLE 18 (cont’d) 



Strand 3 multiplication 



Class 35 • 


6 x 709 = 


8 x 303 = 


9 x 403 = 


Class 50 : 


7x96 = 


1 ! 

X 

00 


9x73 


Class 3 6: 


323 


878 


222 


Class 51 • 


370 


980 


780 




x 2 


x 1 


x 6 




x 98 


X 53 


x 64 


Class 37 : 


22 


63 


88 


Class 52: 


3^5 


957 


747 




x 55 


x 21 


x 11 




x 35 


x 22 


x 23 


Class 381 


230 


620 


110 


Class 53 : 


585 


835 


689 




x 21 


x 12 


x 99 




x 78 


x 78 


X 58 


Class 39: 


3^5 


272 


59^ 


Class 54 : 


789 


987 


837 




x 5 


x 7 


x 2 




x 46 


x 64 


X 96 


Class 40: 


33 


77 


35 












x 54 


x 23 


x 35 










Class 4l: 


5 x24 = 


6 x 66 = 


7x27 = 










Class 4.5: 


323 


613 


666 












x 21 


x 12 


x 22 










Class 43: 


348 


845 


959 












x 7 


x 7 


x 9 










Class 44 : 


45 


89 


55 












x 67 


x 58 


x 79 










Class 45 : 


4 X76 = 


8x25 = 


9x59 = 










Class 46: 


550 


340 


750 












x 25 


x 35 


x 23 










Class 47 : 


450 


980 


590 












x 67 


x 58 


X 

VO 

00 










Class 48: 


897 


839 


748 












X 4 


x 6 


x 9 










Class 49i 


89 


97 


76 












x 63 


x 64 


x 89 











o 
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TABLE 18 (cont’d) 



Strand 4 fractions 


Class 1: 


Look at these letters 

X X 
X X 


Number of letters 
2 < n < 24 




How many letters are there? 

l/4 of 4 = 

1/2 of 4 = 


Begin with : 

1/2, 1/3, 1/4, 1/5, 

1/6, 1/8, 1/10 
then, 2/3, 2/4, 3/4, etc. 


Class 2: 


Number and denominator 






N 

What is the: ^ of each of these fractions? 





2/3, etc. 



Class 


3: 


Type < or = or > 

1/3 _ 2/3 

2/4 1/2 

8 / 1 ° 8/9 

2/5 _ 3/5, etc. 




Class 


4: 


Add or subtract 








1/2 + 2/5 = _ /5 


All like denominators 






2/3 + 1/3 = _ /3 


Some simplifying 


Class 


5: 


Complete each problem 


Begin with different 






1 

i! 

CVJ 


denominators which are 






l/3 = /6, etc. 


different by a factor of 






2/5 = 


2, then 3 , etc. 
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TABLE 18 (cont'd) 



Class 6: Add or subtract 

l/2 + 1/4 = /4 

1/2 - l /6 = /6 

= _ /3 

1/3 + 1/2 = /6 + /6 

= /6, etc., including 

3 + l /2 = /2 + l /2 

= _ /2 

- /2 



One denominator a multiple 
of the other 

Problems may have 2 steps 



Class 71 Complete each problem 

11 / 2 = /2 

5/2 = /2, etc. 

13/2 = __ 1/2 

Class 8: Type < or = or > 

1 1/2 ___ 3/2 

3/4 2 l/4, etc. 

Class 9 • Add or subtract 



1 1/3 


+ 2 1/3 


= (1 


+ _) 


+ 


1/3 + 


_ / 3 ) 






= 


+ ____ 


/3 










= 3 . 


_ /3 








2 3 A 


- 1 iA 


= (2 


- _J 


+ 


( 3 A • 


• _A) 






= 


+ ___ 


A 










= 1 _ 


_ A 












= 1 _ 


_ /2 








2 1/5 


+ 3 lA 


= c 


_ + 3 ) 


+ 


(1/5 H 


h _ A) 






= 


+ (_ 


/20 + __ 


. /20) 



= 5 + _ /20 
= 5 /20 







TABLE 18 (cont'd) 



Class 10: Complete each problem 

5/8 = _ /24 
3/5 = 12/ _ 
n/4 = 3/12 
n = , etc . 

5/4 = 4/4 + /4 

= +1/4 

ss 1/4 , etc. 

Class 11: Multiply 

2xl/3=_/3 

1/4x3 = A 

1/3 x 2/3 = _ /9 
3/5 x 2/6 = _ /30 
= _ /15 

2 lA X 3 lA = (2 + 1/4) X (3 + A) 

= 2 x (3 + _ A)+ 1/4 x (3 + _ A) 

or as a mixed number (see 12) 

Class 12: Divide 

2 divided by 1/3 = 2 x / 

-_/_ 

l/4 divided .by 3 = l/4 x / 

= _ /12 

1/3 divided by l/2 = l/3 x / 

1 l/2 divided by 2 l/3 = 3/2 divided by /3 

= 3/2 X _ / _ 

= _ /!**> 

etc . 



Class 13: 



Mixed 

Combination of problems from sections 9? 10? 11? 12 



4 . Problem Solving 

This program was developed to examine the factors involved in teaching fifth graders 
how to use the computer as a desk calculator to solve multistep word problems. It was 
also designed to permit investigation of variables which might contribute to problem 
difficulty. 

In all, 27 fifth-grade students from the six-year longitudinal study group served as 
subjects for the pilot edition of the program. Sixty-eight word problems were prepared. 

Figure 5 presents the last two problems of the pilot program. As can be seen, the 
program ran on a modified version of the logic program. "Givens" replaced "premises” 
of the logic program. The "givens" were the numbers shown in the problem statement, 
listed in order of appearance. 

In place of giving abbreviations for rules of logic, students gav * operator commands 
such as add (A), subtract (S), multiply (M), divide (Q,), enter a constant (E), or the 
answer is on line N(NX). 

As in the logic program, students were free to proceed independently to find 
solutions . 

Data analysis was begun using as variables in a linear-regression program the total 
number of words in each problem, the minimum number of operations required for solution, 
and the minimum number of different operations required. 

5 . Performance as a Function of Problem Type 

In order to examine differences in performance as a function of problem type at each 
grade level, the average probability correct for several types of problems for each grade 
was determined. Data were obtained from the pretests for blocks 3-8 in Grade 1, blocks 
1-5 and 7~9 in Grade 2, blocks 1-8 and 10 in Grade 3? blocks 1-5 in Grade 4, and blocks 
1-3 in Grade 5 * The average probability correct for some of the problem types examined 
is shown in Table 20 (problem types appearing at only one point in the total curriculum 
are not presented). These averages are based upon performance of from 20-60 S_s with 
a given problem type occurring from 1-15 times in a given block. For a given grade 
and problem type, the successive probabilities are for successive blocks in the curric- 
ulum containing that problem type with the actual block number in parentheses. 

In the dercription of problem types in Table 20 each digit is represented by an 
initial letter of the alphabet. For horizontal problems the digit or digits underlined 
indicate the position of the blank when the problem was presented to the student. For 
addition problems the probability correct did not differ as a function of the number 
of digits in each addend as long as the number of digits in the response were equivalent. 
Therefore, these problems were combined to form a single problem type (e.g„, the second 
problem type in Table 20). 



601 • 103 



COMMITTEE MEMBERS BOUGHT 3 



WI TH 


14 


OUNCES IN 


EACH 


JAR. 


WITH 


27 


OUNCES IN 


EACH 


BOX 


INTO 


BAGS THAT CONTAINED 4 


HOW MANY BAGS OF 


CANDY 


DID 


G 




(1) 


3 




6 




(2) 


14 




G 




(3) 


2 




G 




(4) 


27 




G 




(5) 


4 




1.2M 




( 6) 


42 




3.4M 




(7) 


54 




6.7A 




(8) 


96 




8.5Q 




(9) 


24 





JARS OF CANDY 
AND £ BOXES OF CANDY 
THEY FJT THE CANDY 
OUNCES EACH. 

THEY FILL... 



9X 

CORRECT. 



601. 104 

THIS IS THE LAST WORD PROBLEMS* 



3 CLASSES OF 32 PUPILS EACH# 1 CLASS OF 34 PUPILS# 

4 TEACHERS# AND 7 PARENTS TOOK A TRIP ON 3 BUSES. 
EACH BUS TOOK THE SAME NUMBER OF RIDERS. 

HOW MANY RIDERS WERE ON EACH BUS... 



G 


(1) 


3 


G 


(2) 


32 


G 


(3) 


1 


G 


(4) 


34 


G 


(5) 


4 


G 


(6) 


7 


1.2M 


(7) 


96 


4. 5A 


(8) 


38 


4® 7 A 


(9) 


130 


6.9 A 


(10) 


137 


5. 10A 


(11) 


141 


11. IQ 


( 12) 


47 


12X 






CORRECT. 







Figure 



Last Two Problems in the Problem-Solving Pilot Program, 
Prill - and-Practi ce Mathematics 



y • 
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TABLE 20 

Average Probability Correct as a 
Function of Pr iblem Structure 
Drill-and-Practice Mathematics 



Horizontal Addition 



Problem 


Carry 

or 

borrow 


Grade 


Probability correct 






1 


• 95* 






2 


.95 (1)** -95 (4) -92 (5) -94 (7) 


a + b = c 


0 


3 


.94 (1) -95 (2) 






4 


.95 (1) 






2 


.38 (4) .72 (7) .69 (9) 


a + b = ef 




3 


.69 (1) .75 (2) 


ab + c = ef 


0 


4 


.73 (1) 


a + be = ef 




5 


.61 (1) 


ab + cd = ef 




3 


(1) 080 (2) 




1 


4 


.62 (1) 






5 


067 (l) .68 (3) 






2 


.36 (7) .63 (9) 


a + b + c = de 


1 


k 


.59 (1) 






5 


.85 (3) 






1 


087* 


ab + c = de 




2 


.82 (1) .90 (4) .83 (7) «72 (9) 


a + £ = de 




3 


.74 (1) .79 (2) 


a + £ = d 




4 


086 (l) 






5 


082 (1) 






3 


.31 (1) .41 (2) 


a + be = de 




4 


.36 (1) 






5 


.53 (1) 



*First-grade data is an average of Blocks 3-8 • 

**Numbers in parenthesis indicate block number „ 
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TABLE 20 (cont’d) 



Problem 


Carry 

or 

borrow 


Grade 


Probability correct 






1 


.82 


a + b = cd 




2 


.82 (1) .a (5) .66 (7) .62 ( 9) 


a + be = de 




3 


.68 (1) .79 ( 2) 


a + b = c 




4 


.76 (1) 






5 , 


.81 (1) 






4 


.46 (1) 


ab + cd = ef 


0 


5 


.66 (l) .39 (3) 












3 


.19 (2) 




1 


5 


.47 (1) .31 (3) 



Horizontal Subtraction 



a - s c 




2 

3 

4 


.94 (2) .a (5) .89 (8) .93 (9) 
.88 (1) .93 (3) 

•94 (2) 






3 


.56 (1) .70 (3) 




0 


4 


.80 (2) 






5 


.78 (2) 


• ab - c = de 




3 


.33 (1) .62 (3) 




1 


4 


.44 (2) 






5 


.60 (3) 






2 


.a (2) .83 (5) .71 (8) .91 (9) 


P 

1 

II 

O 




3 


.81 (3) 






5 


.91 (2) 






3 


.66 (1) .65 (3) 


ab - £ = de 




4 


.78 (2) 






5 


.85 (2) 






2 


.32 (2) 


a - b = c 




3 


.52 (3) 






5 


.70 (2) 



TABLE 20 (cont'd) 




Vertical Addition 



a 

+ b 
c 




1 

r\ 

C- 

3 

4 


• 95 

.92 ( 3) .97 P0 -91 (5) -94 (7) -91 (9) 

• 95 (2) 

.96 (1) 






. 2 


.60 (4) .66 (5) .57 (7) .52 (9) 


a 

+ b 




3 


.32 (2) .62 (4) 


T U 

c d 




4 


•37 (1) 






3 


.69 (2) .93 (4) .94 ( 6) .87 (8) .84 (1C 




0 


4 


.72 (1) .95 (4) .92 (5) 






5 


.66 (1) .81 (3) 


ab ab a 




3 


o45 (2) «74 (4) .81 (6) .77 (8) .81 (1C 


cd c be 


1 


4 


062 (l) .87 (4) 081 (5) 






5 


062 (1) «82 (3) 




2 


4 


.71 GO «8o (5) 






3 


•93 (4) .90 (6) .86 (8) 




0 


4 


• 95 (4) .90 (5) 






3 


.69 (4) .82 ( 6) .64 (8) .76 (10) 


abc abc 


1 


4 


.84 (4) .77 (5) 


+de +def 












5 


•79 (3) 






3 


.66 (6) 




2 


4 


.84 (4) .77 (5) 






5 


.64 (3) 



r 



51 



TABLE 20 ( cont r d) 



Problem 


Carry 

or 

borrow 


Grade 


Probability correct 


a 

b 


0 


3 


.80 (6) 


•97 (8) 


+c 


1 


3 


•31 ( 10 ) 


ab 

cd 

•fref 


0 


3 


.87 (4) 


.84 (6) .87 ( 8 ) 


1 


3 

4 


.58 ( 4 ) 
.46 ( 1 ) 


.69 ( 6 ) .73 ( 8 ) ,71 ( 10 ) 




2 


3 


•53 ( 6 ) 


.70 (10) 



a 

-b 



ab 

-c 



ab 

-cd 



Vertical Subtraction 



0 



1 



0 



1 



2 

3 

4 



3 

4 

5 



3 

4 

5 



3 

4 

5 



3 

4 

5 



•93 (3) 
•90 (3) 
.90 (2) 



,88 (5) .91 ( 8 ) .90 ( 9 ) 



.81 (3) 

•TO ( 2 ) 
.70 (2) 



,90 (5) .88 (7) .83 ( 8 ) 
,86 (3) .82 (5) 



•79 (10) 



A2 ( 3 ) -35 ( 5 ) .69 ( 7 ) -75 (8) .72 (10) 
■53 (2) .74 ( 3 ) .78 (5) 

,61 (2) 



■75 (3) .82 (5) .86 (7) .80 ( 8 ) .86 (10) 

.85 (2) .94 (3) .82 (5) 

,83 (2) 



,38 (5) .53 (7) .62 (8) .68 (10) 

.76 (3) .70 (5) 

■54 (2) .73 (3) 



abc 

-de 



0 



.86 (5) 



1 



3 

4 



.47 (5) .61 (10) 
.51 (2) 
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TABLE 20 (cont'd) 



Problem 


Carry 

or 

borrow 


Grade 


Probability correct 






3 


.84 (5) 




0 


4 


.91 (3) 






3 


.45 (5) .66 (10) 


abc 


1 


4 


.58 (5) 


-aei 




5 


.66 (3) 




2 


4 


=46 (3) 




1 


4 


.58 (5) 


abc^ 




4 


.44 (5) 


-efgh 


2 


5 


.43 (3) 






o 
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D . Logic and Algebtoa * Program 

1. The First-year Program 

Lesson writing and programming . The last six lessons in sentential logic and algebra 
were completed, coded and debugged. This completes the program as planned. The 
programming was also completed with all known bugs removed. 

Student progress . Five of the 170 students have now completed the first-year 
materials and have started on the tenth lesson of the second-year materials. Another 
22 students are past the beginning of lesson 30 (octal numbering). It is anticipated 
that most likely the first-year materials will be completed by the end of May. 

Audio l ink . Most programmed instruction is entirely tutorial: the program gives 

instructions and then asks fixed questions with fixed answers. More desired is a 
dialogue in which the student may make unprogrammed communications to the program. The 
logic program is already partially a dialogue in that the student response in derivations 
is not coded, rather the student communicates with the machine in the language of the 
rules of derivation. The machine responds by carrying out the student’s correctly given 
commando. The next step in the program then is to direct investigation to extend the 
use of dialogue. 

We propose to supply the student who is having difficulty -with a machine dialogue ' 
covering possible strategies of proof. Our first step is to learn what questions the 
students would like to ask and what answers are instructive. To do this in a way that 
simulates student-machine dialogue, we have set up one of the teletypes in Walter Hays 
School (where we have both first-year and second-year logic students) with a headphone 
telephone connected with the laboratory on the Stanford campus. A slave teletype 
monitors the student’s teletype, and an experienced logic teacher watches the monitor 
and answers questions from the student. This is usually done with leading questions 
from the teacher. The entire audio dialogue is being tape recorded and transcribed 
for subsequent analysis. 

2. The Second-year Program 

Lesson writing and coding . To motivate the students and to give them an appreciation 
of the axiom system which they are learning, additional lessons were written and inserted 
between the existing lessons dealing with the major theorems. 

Teletype room. Students participating in the second-year algebra program also 
participated in the audio link described above. 



3. The Third-year Program 

The program is still in the planning and lesson writing stages. The logic has been 
extended by introducing the biconditional. There are several lessons on the use of the 
biconditional, including the introduction of new logical rules which enable the students 





I 



• ~ 1 
5 b 

to work with the new connective. In conjunction with the section on biconditionals, 
there is also a lesson on definitions, which is given in a biconditional form. 

For the algebra part of the program, lessons have been written which include all the 
theorems that enable the student to solve linear equations in a single unknown. Lessons 
have also been written which contain a large selection of word problems solvable by this 
type of equation. In addition, there are also theorems which enable the student to 
determine the range of the unknown in any linear inequality, 

A geometry booklet is being prepared which will be used with the algebra. A 
preliminary draft of the section of the booklet dealing with the real number line and 
representations of inequalities thereon has been completed. 

b. Data Analysis 

A thorough analysis of the 1966-67 logic and algebra performance data is now in 
progress. During the period covered by this report, seven major computer programs have 
been developed. These programs: (a) collate and sort the performance data; (b) determine 

proof isomorphisms; (c) list and report results;, and (d) merge new performance data. 
Additionally, work has begun on programs to determine sequential statistics and " protocol” 
isomorphisms . 

Several standard statistical analyses are being exploited in this connection. For 
example, regression analysis is being used to examine the structural variables that 
predict performance, (The format of the logic and algebra curriculum does not permit 
"wrong" answers; hence, probabilities of correctness. One dependent variable considered 
then is the response or problem latency.) 

E . Dial - a- Dr ill Pr ogra*-' 

1. Student Enrollment 

By January 3, the dial-a-drill roster had grown to fourteen students. Four students 
were at or below second-grade level, one was at the third-grade level, and nine were at 
or above the fourth-grade level. 

2. Curriculum Material 

Students up to and including the second-grade level were given addition and 
subtraction problems. Third graders were given problems from these two strands, plus 
problems from the multiplication strand. Fourth, fifth, and sixth graders had a fourth 
strand, i.e., division, added to their curriculum. Table 21 illustrates each of the 
strands and defines the equivalence classes within each, 

A new strand was introduced on February 19. Fractions, as outlined in Table 22, 
began running for the fourth, fifth, and sixth graders. Eighteen new vocabulary words 
were added to accommodate this strand. Answers were accepted in any form, other than 
mixed numbers, if correct. Since measure of difficulty was poorly defined among the 
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TABLE 21 

Addition, Subtraction, and Multiplication Strands 

Dia'l-a-Drill Program 





Additi. on 


Equivalence 

Class 


Type 


Limitations 


1 


m + n - 


0 < m + n < 6 


2 


ii 

sd 

+ 


0 < m + r < 6 










m + = k 




3 


m + n = 


4 < m + n < 10 


4 


+ n = k 


4 < m + n < 10 




m + = k 




5 


All 3 types: 






i.e . , m + n = 


7 < m + n < 13 




m + = k 






+ n = k 




6 


All 3 types 


10 < m + n < 17 


7 


All 3 types 


13 < m + n < 20 


8 


m + n = 


19 < ab + cd < 29 






b + d < 9 






a or c may be 0 


9 


All 3 types 


19 < ab + c < 29 






b + c < 9 


10 


All 3 types 


30 < ab + c < 49 






b + c < 9 


li 


m + n = 


200 < abd + def < 1900 






b = c = e = f = 0 


12 


m + n = _____ 


30 < ab + cd < 49 






b + d < 9 


13 


m + n = 


50 < ab + cd < 99 






b + d < 9 


14 


m + n = 


3.9 < ab -i- c < 99 






b + c > 9 
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TABLE 21 (cont'd) 





Addition 


Equivalence 

Class 


Type 


Limitations 


15 


m + n as 


110 < a'bc + de < 999 
e 0 

b + d < 9 


16 


m + n = 


110 < abc 4 de < 999 
c 4- e < 9 
b 4 d < 9 


IT 


m + n -• 


31 < ab 4- cd < 99 
b + d > 9 


18 


m + n = 


100 < ab 4- cd < 198 
D 4' d > 9 
a + c > 8 


19 


m + n = 


110 < abc + de < 999 
b 4 - d < 9 
c 4- e > 9 


20 


m + n as 


110 < abc 4- de < 1098 
b + d > 8 
c 4- e > 9 





Subtraction 


Equivalence 

Class 


Type 


Limitations 


1 


m - n - 


0 < n < m < 6 


2 


m - = p 


0 < n < m < 6 


3 


1 

II 

d 

! 

S3 


k <m<10, n<m 


1* 


PU 

d 

1 

1 


0 < n < m < 6 


5 


m - ~ p 


k < m < 10, n < m 


6 


b~ 

1 

!! 

1 


7 < m < 13 s n < m 


7 


- n = p 


4 < m < 10, n < m 


8 


m - = p 


7 < m < 13, n < m 
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TABLE 21 (cont'd) 



Equivalence 

Class 


Subtraction 


Type 


Limitations 


9 


- n « p 


7 < m < 13, n < m 


10 


All 3 types: 






i.e,,m - n - 


10 < m < 17 , n < m 




Hi ~ r: p 






- n = p 




11 


All 3 types 


15 < m < 20 , n < 9 


12 


m - n ss 


20 < m < 99 , n < 10 


13 


All 3 types 


20 < m < 99 5 n < 10 


lk 


m - n = 


10 < m < 99 






n = 10 x a 


15 


All 3 types 


10 < m < 99 






n ss 10 x a 


16 


ab - cd = 


20 < ab < 99 , d < b 






c < a 


17 


ab - cd = 


■ 




ab - = ef 


20 < ab < 99? c < a 




- cd = ef 


d < b 


18 


abc - de = 


110 < abc < 999 






d<b, e < c , d ^0 


19 


abc - de = 


110 < abc < 999 




abd - = fg 


d < b 




- de = fg 


e < c 






d £ 0 


20 


i 

11 

0 

1 

■8 


20 < ab < 98 






d > b, a > c 


21 


i 

11 

TJ 

0 

1 

■8 


20 < ab < 98 




o' 

1 

i 

II 

CD 


d > b, 




HH 

<U 

11 

O 


c < a 
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TABLE 21 (cont T d) 



Equivalence 

Class 


Multiplication 


Type 


Limitations 


1 


a x b = 


0 < a x b < 10 


2 


All 3 types: 






i . e . , a x b = 
ax = ct (if a = c.-, f 0 ) 
x b=c (if b = c, ^ 0 ) 


0 < a x b < 10 


3 


a x b = 


8 < a x b < 3° 


k 


All 3 types 


8 < a x b < 30 


5 


a x b = 


21 < a x b < 8 l 


6 


All 3 types 


21 < a x b < 8 l 


7 


a x be - 


0 < a x b < 20 






b ^ 0 , c = 0 


8 


All 3 types 


0 < a x b < 20 




of a x be = def 


b £ 0 , c = 0 , 


9 


a x be = _____ 


20 < a x b < 8 l 






O 

1 H 

O 

0 

-SL. 

1 


10 


All 3 types 


20 < a x b < 8 l 




of a x be = def 


b / 0 , c = 0 


ll 


ab x cd = 


b = d = 0 

1 < a 5 c < 9 


12 


All 3 types 


1 < a, c < 9 




of ab x cd = efgh 


b s= d = 0 


13 


abc x d = 


b = c = 0 

1 < a, d < 9 


Ik 


All 3 types of 


b = c = 0 




abc x d = efgh 


1 < a, d < 9 


15 


a x be = 


1 < a,b,c < 9 


16 


ab x cd = 


b = 0 

10 < cd < 99 






- 
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TABLE 21 (cont'd) 





Division 


Equivalence 

Class 


Type 


Limitations 


1 


c / a = 


0 < c < 10 , a / 0 


2 


All 3 types 


0 < c < iO, a ^ 0 




i „e . , c / a - 






c / - b 






/ a = b 




3 


c / a = 


8 < c < 30 , a / 0 


4 


All 3 types 


8 < c < 30 , a / 0 


5 


c / a = 


21 < c < 8 l, a > 3 


6 


All 3 types 


21 < c < 8 l, a > 3 


7 


def / ab = 


0 < def < 200 




def / c = 


a -£■ 0 , b = 0 


8 


c / a = 


a = 9 ? 11 , or 12 




c / = b 


and / or 




/ a - b 


b = 9 , 11 or 12 


9 


def / a = 


2 < def < 888 






d, e, and f even no r s. 






a = 2 


10 


def / a = 


2 < def < 898 






d, f even no* s 






a = 2 


n 


def / a = 


2 < def < 998 






d and/or e even no’s 






a = 2 


12 


All 3 types of 


0 < def < 200 




def / ab = c 


a / 0, b as 0 


13 


def / ab - 


200 < def < 810 




def / c = 


a / 0, b = 0, f = 0 


l4 


def / ab = 


10 < def < 480 






0 

1! 



o 



6 o 



TABLE 21 (cant'd) 



Equivalence 

Class 

15 



Type 

All 3 forms of 
def / ab = c 



Division 



1 6 



17 



cdef / g 
cdef / gh 
cdef / ghi 
cdef / ghij 

cdefg / hi 
cdefg / hij 
cdefg / hijk 
cdefg / hijkl 



Limitations 
200 < def < 810 
a ^ j b =0 

d=e = f = h = i 
a = 1 or a = c 



d = e = ft=g = i 
a = 1 or a = c 
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TABLE 22 

Fi action Strand, Dial-a-Drill Program 



Equivalence 

Class 

1 

2 

3 

k 



Form 

m/n = ?/k 

m/n - k /? 

l/n of m = 

l/n of m = 



Fraction Strand 

L imitations 

reduce or expand 
only to up to 9th ? s 

reduce or expand 
only go up to 9th 1 s 

2 < n 5 ^ 

m/n is integer 

k < n < 8, 12 < m < 32 
m/n is an integer 



5 

6 



n/m of m -• 
n k 

m m — 



7 




8 

9 

10 

11 

12 



n _ k 
m m ” — 

n _ k 
m T — 

n/m x k/m 

n/m x k/m 

n/m x k/m 



13 

14 

15 



~ x k/t 
x k/t 



m 

n 



m 



n/m x k/t 



1 < n < 8; 2 < m < 9 

n < m 

2<n+k<9, 1 < m < 9 

a + £< i 

m m — 



1 < n, k 



2 < n, k < 9 ; 2 < m, t < 9 



s + | < l 

m t — 



Same limits as t, k < n 

... „ n ^ k 

Same limits as 7 , — > r 

III 0 

2 < m < 5 > n x k < 10 

4 < m < 7 5 10 < n x k < 30 < 

6 < m < 9 ? 24 < n x k < 8l 



The term 
18 over' 5 
will he 
used here,, 

(i.e.j'2/15" 

will he 
read "2 
^over 15") 



Same restrictions as No, 10 

Same restrictions as No« 11 4 

Same restrictions as No. 12 



The term 
"over" 
will he 
used here. 
(ioe o ; 5 2/l5" 
will he 
read "2 
^over 15") 



o 
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TABLE 22 (cont'd) 



Begin with one problem from each of levels 

1 , 2 , 3 , 6 , 8 , 10 

"Intuitive difficulty" lay-out is 

1 6 8 10 

2 7 9 11 

3 13 ? 

b 12 ? 

5 lb 

15 
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various types of problems, students began with one problem from each of classes 1, 

2, 3, 6, 8, and 10. 

3- Evaluative Procedures 

On February 19? several changes were instituted. Until this time, if a problem was 
answered correctly after the first or second statement of the question, it was considered 
correct. Beginning February 19, & problem was correct only if the response was correct 
on the first trial; half credit was given for a correct answer on the second trial; and 
no credit was given for an incorrect response or no response. 

Also beginning February 19, students were broken up into two "matched" groups for 
the addition and subtraction strands. One group continued to receive problems in blocks 
of 10 and branched according to previous criteria. The other group’s performance was 
evaluated after each problem. A correct response moved the student up one level, a 

correct answer on the second trial kept him at the same level, an incorrect response 

dropped him one level. After four weeks of running in this manner, the two groups were 

switched . 
k . Data Analysis 

Figure 6 shows the progress of a typical student who is assessed after completing 
10 questions in an operation. In this case, levels 1 to 5 & re shown as successfully 
completed, but progress is slower in levels 6 to 10 which are repeated once or twice. 
Level 11 is failed, giving a return to 10. Figure 7 shows the performance curves for 
several students. There is a discernable pattern of repeats and failures at levels 
!|. ? and 10, which these students have found particularly difficult. 

Figures 6 and 7 represent the original scoring scheme (9, 10 advance, 0-6 fail) where 
equal credit was given for a correct answer on the first or second attempt. Figure 8 
compares the two subsequent scoring systems. The upper line shows assessment after each 
problem (a correct response on the first attempt advances the student, if a correct 
response is given on the second attempt the same level is repeated, otherwise the next 
lower level is selected). The lower line indicates 10 questions per level, with half 
credit for correct responses on the second attempt. The students compared here had shown 
signs of settling in the region of level 12 on the original scoring system. Although 
the range is comparatively great when changing levels on each problem, the mean is in 
the 15“l6 area. On 10 problems per level, the other student has moved to the 10-12 

range . 

The effect of raising the average level by adopting the "one problem" scueme, and 
depressing it by the half-credit change, was notable in nearly all the students. 



3 

ERIC 



& 




13A31 



O 

CM 

CM 



§ 



O 

CD 



O 

CD 



O 

* 



O g 

CM 2 
— LlI 
-J 
CD 
_ O 
o cc 

O CL 



O 

00 



s 



o 



o 

*M 



O 



O 

ERIC 



Figure 6. Performance Curves on Student 1 in the Addition Block* Dial-a-Drill Program 
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Figure 8. Performance Curves of Students 6 and 1 in 
the Subtraction Block under Two Scoring 
Systems, Dial-a~Drill Program 






- *•'»«*- * 



Figure 9 shows the progress of a student who worked from the start on the "one 
problem" system. A comparison with Figure 6 shows increasing failure rather than level 
repetition as difficulty is found. 

F. E lementary Russian Program ■ 

1. Preparation of Material 

Computer - based lessons . Dnt: Hundred lessons have been completed and entered into 
the computer. Material for the remaining lessons has been selected and outlined. The 
data on student performance is being used in the revision of lessons already given to 
our students . 

Language - laboratory tapes . Tapes of the type described in the previous progress 
report were prepared and employed at the rate of two tapes per week for the 10 weeks of 
the Stanford 1968 winter quarter. 

Pronunciation evaluation tapes . Three additional tapes were required of our 
students during the period under consideration. Student performance continues to be at 
a high level. 

Homework assignments . Nome-work assignments covering lessons by through 92 were 
prepared and distributed during the winter quarter. 

Course su mmaries . A mid-term ?nd quarter final summary, as well as individual study 
sheets covering the material in lessons 47 through 92? were prepared and distributed to 
the students , 

. Preprocessing Programs 

The preprocessor has been mod if i -1 to allow the lesson programmer to drill the 
student on the forms of a given noun, verb or adjective simply by listing (a) the basic 
form or forms of the stem in question; (b) the forms to be drilled; and (c) the 
appropriate paradigm number. The preprocessor then makes use of a set of desinence 
tables to generate the appropriate paradigm in a " complete- the-endings" frame. 

Another improvement in the preprocessor is the introduction of a special "remedial- 
bi'-c.':" subr ratine which allows the lesson programmer to convert a wide variety of frame 
types tr the test-block structure previously available only in a single- frame format. 

3. Additional Supporting Programs 

The program on which lessons are run has been modified to allow the use of nested 
remedial blocks in future lessons. The value of these blocks will be greatly increased 
by permitting the students to skip some of the remedial work in a block if they respond 
successfully to test items within the block itself. 

4 , Overall Approach 

No basic changes have been made in the approach discussed in our first report. The 
continued success of our students (see section 5) indicates that our approach is working 



well . 



Figure 9 
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5 . Results of Comparative Examinations 

Approximately 66 per cent of both the mid-term and the final examinations for the 
winter quarter were identical both for the computer-based and for the regular Russian 1 
sections. Table 23 shows results from the mid-term. Table 2b shows results from the 
final . 

While the performance of the computer-based group continues to be superior to that 
of the regular group, the most striking difference is in the number of students who 
continued with second-quarter Russian. A much larger percentage of students remained 
in the computer-based group than in the regular group . In view of the fac that students 
who fail to complete at least one year of college Russian know too little to use the 
language effectively, it would appear that computer-based instruction would avoid much 
of the wasted time and effort which mark present-day university language courses. 

6. Disk-generated Audio Stimuli 

In cooperation with programmers at the Stanford Computer-based Laboratory, we have 
investigated various approaches to the generation of audio stimuli from the computer 
disk instead of from tapes. The storage of subsyllabic components was found less 
satisfactory than the storage of whole words, and the material needed for one of our 
early lessons has been listed and recorded on the disk. 

7. Optional ‘Videotape Course in the Comprehension of Spoken Russian 

The preparation of videotapes of the type discussed in the last quarterly report is 
continuing . 

G. Spelling Program 

1. Individualized Spelling Lists 

As part of the main experimental effort for this year, the collection of individ- 
ualized'.spelling lists was begun and completed. These lists are 48 words long and 
contain words each child missed during the testing period over the 1,500-word pool 
contained in the program. About 350 words, with some missed by as few as 2 and some 
missed by as many as 30, make up the list for the 65 or so children in the main project. 
Each child's list then formed his words for the investigation of optimization methods in 
computer-based instruction spelling instruction. 

The collection of the data for this experimental investigation was 90 per cent 
complete by the end of the Quarter. Work was started on the development of analysis 
programs for this data. 

The alternate group of students running outside the main experiment consists of very 
poor spellers. Because their language arts work in general is quite poor, they are not 
being included, as was planned, in the investigation of the enriched drill environment. 




TABLE 23 

Results of First-year Russian Winter Quarter Mid-term Exam 

(Common Portion) 

Elementary Russian Program 



Number of Errors 


Number of Students 
Computer-based Regular 




1 




^.5 


1 




5 


1 




5.5 




1 


6 


3 


1 


7 




1 


7.5 


1 




8 


3 




8.5 


2 


1 


9 


1 




9.5 


2 


2 


10 




1 


n 




2 


12.5 




1 


13 


1 




13-5 


2 




14 


1 




14 .5 




1 


15 


1 




15.5 




1 


16.5 


1 


1 


17 


1 


1 


18 


2 




18.5 


2 




20 


1 




32 


1 




36 




1 


Total number of students 


28 


15 


Total number of errors 


335 .5 


190 


Average number of errors 


12.0 


12 .7 






TABLE 24 

Results of First-year Russian Winter Quarter Final Exam 

(Common Portion) 

Elementary Russian Program 



Number of Errors 


Number of Students 
Computer-based Regular 


2 


1 




6 


1 




6.5 


1 




8 


1 




9.5 




1 


10 


1 




n 




1 


12 


2 




13 




1 


14.5 




1 


1 6 


1 




16.5 


1 




18 


1 




18.5 


1 




19 


1 




19.5 




1 


21 


2 




22.5 


1 


1 


23 


1 


1 


23.5 


1 




24 


1 




24.5 ' 




1 


25 


1 




26.5 




1 


27 


1 




29.5 


1 




30 




1 


30.5 




1 


32.5 




1 


33 


1 




37.5 


2 




38 


1 




39.5 


1 




4 l 


1 


2 


47 .5 




1 


Total number of students 


27 


15 


Total number of errors : 


587.5 


386.5 


Average number of errors- 


21.8 


25.8 
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The present plan is to use the main group as soon as it has completed its' work under 
the optimization routines* 

The number of children served at the four teletypes per day continues to be slightly 
over 50 per day. This is about the level that was attained at the close of the last 

reporting period. The monthly figures are: 

Number of Days Children £er Da^r 

Jan. 20 

Feb . 18 

Mar . 20 



53 

52 

53 



2 . Teacher Education . tj 

As was forecast, a version of the driver designed to be used in "teacher training 

activities was prepared but has not been tested nor fitted to real subjects because of 

the volume of work now occupying the Computer-based Laboratory. It will probably be 

summer before this can be done. 

H. Stanford PDP-1 System 



1 . Hardware 

A series of major hardware problems began with air-conditioning troubles during the 
first few weeks in January. The removal from the Stanford Computation Center of the 
Burroughs B-5500 computer led to a lengthy period of efforts to restabilize the machine- 
room air conditioning, which also serves our PDP-1. High temperatures and improper air 
flow patterns caused numerous failures in almost every piece of our equipment and forced 
several periods of complete shut-down. Most of the difficulties were resolved after 
three weeks, but short periods of similar trouble occurred at intervals throughout the 

following months* 

The Mississippi PDP-8 system was down the first few days in January. Efforts to 
locate the trouble from Stanford were not successful, and a field engineer was called in 
from the DEC office in Houston. The failure was in the 637 high-speed line interface 

controlling the line to Stanford. 

Kentucky rejoined the system during this quarter, with tests of the cross-country 
line and EDP-8 beginning January 17 . While the Kentucky system itself has performed 
reasonably well, a long series of problems arose in the Kentucky-Stanford telephone line 
and in the computer interface to this line at Stanford. On January 26, after several 
days of intermittant failures, a bad circuit card was found and replaced in the 63 7 at 
Stanford. This improved the situation considerably, but remaining mysterious failures 
were the subject of almost daily efforts in signal tracing and circuit study. In 
mid-February a design flaw was found and corrected in the 6 3 7 - Under certain heavy . 
system load conditions, this bug caused the high-speed line to lose synchronization in 
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such a way that it could be re-established only by reloading the PDP-8 program. This 
flaw has not yet been corrected in the 637* s at Mississippi and Kentucky, since there is 



These measures still did not completely clear up the problems, however, and efforts 
to locate the remaining bugs are continuing. The outstanding problem at this time is 
an intermittant failure which not only drops the Kentucky line, but also causes the 
Stanford PDP-8 to hang up, dropping all teletypes in the system. 

On March 1, the power failure trap circuitry was installed in the Kentucky PDP-8, and 
appears to be working satisfactorily. During the latter part jf March, the Kentucky 
PDP-8 system developed a solid failure. Diagnostic procedures indicated the trouble was 
in the 680 local teletype controller, and Mr. Robert Simmons wa>i sent to Kentucky to 
repair it. A burned out resistor was found on one of the circuit cards. 

The PDP-1 system was down for several days near the first of February for emergency 
maintenance on one of the 1301 disk files. The main shaft bearings had to be replaced, 
a major undertaking which involved complete dismantling of the mechanical assembly. Some 
teletype service was conducted on an emergency basis for a scheduled demonstration, and 
normal service was restored by February 3« 

In February a punched card dialing unit and a computer-driver dial- out unit were 
■installed for use with the dial-a-drill program. The effectiveness of each type of unit 
will be evaluated during extended experimental use . 

During this reporting period several new instructions were added to the PDP-1. This 
step completes the modifications needed for the effective use of the index register. 

The new Model-37 Teletype was delivered and put into service in March after a special 
interface to the PDP-8 was designed and constructed. This unit types 50 per cent faster 
than the other teletype models, and features a much larger character set, using both 
upper-case and lower-case Vetters, It will be used for high quality document printing, 
as well as normal listing functions within the laboratory. 

2. Software and Operations 

Before bringing up the Kentucky remote' operation, certain modifications had to be 
made in both the PDP-1 and PDP-8 software. Most of' these changes related simply to the 
increased number of teletypes in the system, but the more complicated adjustments 
involved the logistics of operating several remote clusters instead of only one. The 
PDP-8 console teletype intercom logic had to permit selective communication with several 
stations, and PDP-8 program loading techniques had to allow for reloading one system 
while maintaining normal service on all othe'r remote clusters* The new versions of the 
operating systems were put into trial service beginning ' January 11, approximately a. week 
before scheduled contact with the Kentucky system. 



no indication that the critical timing condition ever arises in the remote systems.. 
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The Stanford PDP-8 program has also been keeping daily statistics on various 
parameters of system usage, which will influence future modifications to improve the 
efficiency of the system. 

Especially after bringing Kentucky on-line, the system has seen extremely heavy 
service loads during this period. While there have been serious hardware problems, as 
detailed above, the software systems have become very stable. Very few system's failures 
can be attributed to software, and at this writing the time- sharing system has passed 
well over 200 hours of continuous operation since it was last reloaded. 

3. Demonstrations 

Remote demonstrations of the teletype programs were conducted via acoustic couplers 
in Palo Alto and Redwood City, California, and Houston, Texas. Evening demonstrations 
were also held at the Walter Hays School using their normal facilities. 

I . Stanford- Brentwood System 

1 , Hardware 

During the week of March 18, 1968, we experienced major magnetic tape problems. The 
daily performance tapes generated by student sessions contained several read errors, i.e., 
hard- tape errors. Approximately 20 single-performance records were lost. Out of an 
average of 5 *000 records per day, this is a small number. However, the record loss will 
leave holes in the data. All tapes in question have been dumped, so we can see where 
these holes occur. 

The tape problem was solved in two ways. First, several parts, including the read/write 
heads, were replaced on the tape unit in question. Second, a procedure for cleaning and 
certifying tapes was implemented. 

2. Software 

The group sign-on program described in the previous report was completed and is now 
in use. The display- graphic (DG) function was further modified to display a string of 
graphics, rather than just one. A display-text (DT) function was written to parallel the 
DG function using characters instead of graphics. To supplement the FORTRAN-function 
converter described in the previous report, a subroutine was .written which generates 
response identifiers for FORTRAN-coded functions. 

The weekly math report was modified to use only the first two digits of the four- 
digit student number to identify a student. Several minor modifications of a debugging 
nature were made to the daily reading report. 

Several programs in the Stanford monitor were modified or rewritten. The initializer 
(INITZ) was completely rewritten to allow a more reasonable and flexible control card 
input and to interface with the CAI disk directory to check for space to put the monitor. 
The supervisor (LQADR) was modified to be more tightly coded. The bootstrap was j 



modified to remove a seek command if the disk is already at home cylinder. The bootstrap 
punching program (BOOTP) was completely rewritten to allow punching a specified number of 
bootstraps for selected disk drives , rather than always punching 10 bootstraps each for 
all of our six drives. The pause program (PAUSE) was modified to print messages to the 
operator to inform him of entrances to and exits from PAUSE. 

A program (LSTDK) was written to list the CAI directories of all disks which are 
mounted and ready at the time the program is executed. The program to sequence number a 
deck (SEQNR) was modified to allow arbitrary starting number and arbitrary increment. 

After an initial training program, our new systems programmer, Mr. Stuart C. Miller, 
began the major rewrite on the tape-file maintenance program for course segments (PTTTP). 

II. Activities Planned for the Next Reporting Period 

A. Brentwood Mathematics Program 

Manuscript production, art work, filming, recording, coding and debugging of the 
remaining material for this year’s programmed curriculum will be completed. 

The operation of the laboratory for student use will continue until the end of the 
school year in June. 

Additional material for next year’s curriculum will be written, and most of the art 
work and recording will also be done. Coding of the revised curriculum will commence 
before the end of the quarter. 

Work on diagnostic tests and data analysis will also continue during the next quarter. 

B. Brentwood Reading Program 

During the next reporting period, the Reading Project will concentrate on data 
analysis and on ar.: end-of-the-year evaluation. This evaluation will include an extensive 
posttesting program. A description of this testing program will be included in the next 
quarterly report. During the next quarter the programming staff will continue debugging 
Levels VI and VII to prepare them for student use. 

The behavior and progress of the seven remedial fourth-grade students who began work 
on March 13 will be described. Also to be included will be the second set of observations 
of children’s behavior while working at the CAI terminals. 

C. Drill - and - Practice Mathematics Program 

Results of the problem-solving program using the computer as a desk calculator to 
solve multistep problems and examination of additional variables will be reported next 
quarter. 

The problem-solving program will be expanded considerably to include problems for 4 
third through sixth grades and beyond. The digits allowed in a number will be increased 1 
from the present six to fourteen. This will permit problems using much larger quantities V 
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than before, and should make the problems more interesting. A larger proportion of 
problems from science will be included in the expanded program. 

D„ Logic and Algebra Program 

1. The First-year Program 

As students continue to complete the first-year lessons, they will be put into the 
second-year program. 

Work with the audio link will be continued. The tapes will be studied to see if 
student questions can be standardized into a simple code which students can use at the 
keyboard, since computer recognition of student speech is not now possible. At the same 
time, answers will be examined to see if they can be condensed into a manageable list of 
recorded messages. The next step would be to write a program for selecting appropriate 
audio messages to respond to student question codes. 

2. The Second-year Program 

The remaining lessons of the second-year program will continue to be written and 
coded. 

3 . The Third-year Program 

The next quarter will be devoted primarily to writing lessons which are concerned 
with simultaneous linear equations. The corresponding part of the geometry booklet will 
also be prepared. 

E. Dial- a- Drill Program 

We plan to reassess the difficulty of the equivalence classes within the strands 
according to observations of the students that are presently running. 

Since we plan to continue the procedure of evaluation after each problem, it will be 
necessary to tighten the definitions of each equivalence class and, as a result, to 
increase the number of classes per strand. 

F. Elementary Russian Program 

In the next quarter we plan to complete our computer-based course. Two language- 
laboratory tapes will be made per veek and a homework assignment and a study sheet will 
be issued for each computer-based session. Comparative data on the computer-based and 
regular groups should be obtained from the Stanford spring quarter mid-term and final 
exams, and at least three more pronunciation-evaluation tapes will be required from each 
of the computer-based students. 

The drill-generating routine will be coordinated in the preprocessor with a set of 
coded form-generation rules which will include data on remedial-block responses. This 
should lay the basis for the generation of individualized form drills on the basis of 
a day-by-day analysis of student performance. 
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A construct! on- dr ill generator and a routine to generate analytic nested remedial 
blocks for certain types of construction will begin. 

The listing and recording of disk-generated stimuli for the early parts of our course 
will continue. 

Preparation of videotape material will continue. 

We will continue to use the results of the data analysis in revising the remaining 
portiqn of our course. 

G. Spelling Program 

The major activity for the next quarter will be the analysis of the data generated by 
the experimental study of optimization routines. 

The experimental investigation of the effect of an enriched drill environment will be 
the main activity for the spelling program itself. The rationale behind this study is 
contained in Lorton (1968). 

H . Stanford PDP- 1 System 

During the next several months we anticipate a growing emphasis on hardware work. 

Most of the staff will be involved with at least one of several major projects. Final 
design* construction, and interfacing should complete the core-memory multiplex system, 

A special data channel must be designed and built for the new IBM 2314 disk file due for 
delivery in July. Equipment selection and interface design is also anticipated for 
several other major items. 

I . Stanford-Brentwood System 

Tfye modifications to PTTTP will be completed. The major undertaking will be to 
document the systems software and operating procedures in all areas of Systems and 
Operations Group responsibility. 

III. Personnel 

Brentwood mathematics prq>gram . Miss Briana Burns, technical editor, left the staff 
in January as did Mrs. Sharon Forstenzer. Miss Gail Richens was hired as a computer 
operator and Miss Carol Christensen as a proctor-writer. 

Brentwood reading program . Mrs. Meredith Smith, Mrs. Dana Jones, and Miss Christine 
Herliok resigned from their positions as curriculum writers . Miss Kathy Thomas became 
a full-time coder and Mrs. Helen Bernard resigned from the coding staff. 

Stanford - Brentwood system * Mr. Stuart C. Miller Joined the staff as full-time 
systems programmer. 

Logic and algebra program . For the second-year program, Klaus Galda, Bob Titievand 
Marilyn Cox will alternately supervise the teletype room at Walter Hays. Joseph Offir, 
Research Assistant, was assigned to assist with data analysis, Klaus Galda worked on the 
third-year program this quarter. 
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Elementary Russian program . Cordy Bodkin was replaced by Irene Brunot. 
IV, Dissemination 



A. Publications 

Atkinson, R. C. Computer-based instruction in initial reading. 
Invitational Conference on Testing Problems . Princeton, N. 
Service, 1968, Pp. 55-5^7 



Proceedings of the 1967 
J.: Educational Testing 



Atkinson, R. C. The role of the computer in teaching initial reading. Childhood 
Education , 1988, 44 , 464-470* 

Lorton, P., Jr. Increasing teacher-like behavior within computer-based drill-and 
practice programs. Stanford Review of Education , 1968, J, 34-42. 



Suppes, P., Hyman, L., & Jerman, M. Linear structural models for response and latency 
performance in arithmetic on computer-controlled terminals. In J. P. ni~± 

Minnesota Symposia on Child Psychology . Minneapolis: Univ. Minn, Press, 97* 

Pp .160-200 . 

Suppes, P. Some theoretical models for mathematics learning. J. of Res . and Development 
in Educ. , 1967 ? !,» 5-22. 



B. Lectures 

Anselm, K. Look, look, see CAI. Lecture presented at Brentwood to ARE> Classroom 
Teachers Committee, Richmond, California, February 1, 1968. 

Anselm, K. Computer control. . .does not compute. Lecture presented at Conference on 

New Educational Technologies, Higher Education Seminar, United States Student Press 
Association, San Mateo, February 23, 1968. 

Anselm, K. What to do until the computers arrive. Lecture presented at New Educational 
Technologies, Higher Education Seminar, United States Student Press Association, 

San Mateo, February 24, 1968. 

Anselm, K. Read the signs: the school of the future is here today. Telelecture via 

telephone, Educational Media Specialist Institute, University of Colorado, Boulder, 

March 9? 1968. 

Atkinson, R. C. Models for short-term memory. Seminar presented at the Psychology 
Department, University of Toronto, January 23, 1968. 

Atkinson, R. C. Computer application in teaching. Lecture presented at the Ontario 
Institute for Studies in Education, Graduate Department, School of Education, 

University of Toronto, January 23, 196S. 

Atkinson, R. C. Computerized instruction and the learning processes. Invited lecture 

presented at the Educational Research and Development Council, University of Minnesota, 
Minneapolis, January 25, 1968. 

Atkinson, R. C. Some speculations on storage and retrieval processes in long-term memory. 

* Invited lecture presented at the NASA Conference, Ames Research Center, February 2, 

1968. 

Atkinson, R. C. Some two-process models for memory and learning. Two lectures presented 
at the Institute of Human Learning* S Research Seminary, University of California, 
Berkeley, February 7 , l4, 1968. 

Atkinson, R. C. Computerized instruction and the educational process. Lecture presented 
at the School of Education, University of California, Santa Barbara, February 20, 1900 . 
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Atkinson, R. C f Some two-process models for memory. Colloquium presented at Department 
of Psychology, University of California, Santa Barbara, February 20, 1968. 

Atkinson, R. C. Computer-based instruction. Invited lecture presented at American 
Society for Curriculum Development, Atlantic City, March 11, 1968. 

Berkowitz, L. D. Computer-based instruction in arithmetic (the drill-and-practice 

program). Seminar in CAI, School of Education, Stanford University, January 24, 1968, 

Binford, F. H. Computer-assisted instruction in logic. Lecture presented at Northern 
California Teachers of Mathematics, Sacramento Conference, March 30? 1968. 

Friend, J. E. Mathematics at Brentwood. Lecture presented at seminar on computer- 

assisted instruction, Stanford University, Stanford, California, January 31? 1968. 

Friend, J. E. The first year- and -a-half at the Stanford-Brentwood Computer-assisted 

Instruction Laboratory. Lecture presented at seminar on computer-assisted instruction, 
Orange County Elementary Administrators Association, Anaheim, California, February 21* 
1968 . 

Friend, J. E. Geometry in the primary grades. Lecture presented at Regional Mathematics 
Conference of the California Mathematics Council, Northern Section, and Sonoma, Lake. 
Mendocino County School Offices, Ukiah, California, February 24, 1968. 

Friend, J. E. Mathematics at Brentwood. Lecture presented at seminar on computer- 
assisted instruction, Stanford University, Stanford, California, March 5? 1968. 

Friend, J. E. Computer-assisted instruction. Lecture presented at Laura M. Hansen Home 
and School Club, Saratoga, California, March 18, 1968. 

Jerman, M. Computer frontiers in teaching. Two lectures presented at the Individualized 
Instruction Conference, Cabrillo College, Aptos, California, March 23, 1968. 

Jerman, M. Workshop in computer-assisted instruction conducted at Morehead State 
University, Morehead, Kentucky, February 1-3, 1968. 

Suppes, P. Survey of computer-assisted instruction. Institute for Computer- as sis ted 
Instruction, Rickey’s Hyatt House, Palo Alto, January l6, 1968. 

Suppes, P. Computer-assisted instruction at Stanford. Lecture presented to Faculty 
Women Newcomers, Stanford University, January 18, 1968. 

Suppes, P. The use of computers in education. Lecture presented at Century 21 Lecture 
Series, Stanford University, February 6, 1968. 

Suppes, P. A look at the data. Lecture presented at AERA Symposium on CAI: Bane or 

Boone?, Chicago, February 8, 1968. 

Suppes, P. Problems of evaluation in computer- assisted instruction. Lecture presented 
at Education Development Center, Cambridge, Massachusetts, March 5? 1968, 

Suppes, P. Problems and prospects of computer-assisted instruction. Lecture presented 
at Colloquium, Education Research Center, Massachusetts Institute of Technology, 
Cambridge, March 6, 1968. 

Suppes, P. Computer-assisted instruction. Lecture presented at Workshop on Computers, 

San Mateo County Board of Education, March 13? 1968. 

Suppes, P. Systems analysis of computer-assisted instruction. Principal speaker at *>- 
Session on Education at the Forum on Systems Analysis and Social Change. Annual 
Meeting of American Institute of Aeronautics and Astronautics, Washington, D. C., 

March l8, 1968. 

Suppes, P. Stimulus-response theory of language learning and the the,ory of automata. 
Invited lecture presented at Western Psychological Association, £tan Diego, 

March 29? 1968. 
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Wilson, H. The Stanford CAT Project. Lecture presented at Institute for Computer- 
assisted Instruction, Palo Alto, California, January l6, 1968. 

Wilson, H. Computer-assisted instruction in the elementary schools of New York City. 
Participant, panel discussion, national convention of the American Association for 
School Administration, Atlantic City, New Jersey, February l), 1968. 

Wilson, H. Dialogue No. 45 : Technological Innovations. Participant, panel discussion, 

Association for Supervision and Curriculum Development, Atlantic City, New Jersey, 
March 11, 1968. 

C. Visitors 

Stanford - Brentwood Laboratory . Visitors to the Laboratory numbered 760 individuals 
during this reporting period. Included in that number was one group of 80 visitors 
representing 44 institutions of higher learning. 

The large number of groups and range of interests have on occasion made it necessary 
for over a dozen project staff members to assist with the visitors. Special interest 
areas included computer hardware; computer software, mathematics-curriculum development; 
reading- curriculum development; inservice education; data analysis and reduction; project 
laboratory facilities; teacher education for this environment, etc. 

Regularly prescheduled visiting times have been in effect throughout the reporting 
period, while special arrangements have been made to accommodate large groups of teachers, 
students, or foreign visitors who cannot fit into the regular schedule. Although most 
groups to the Laboratory number fewer than 10 because of limited space, there have been 
groups as large as l8. 

Each Laboratory visitor spends about one hour viewing children at the terminal 
equipment, interacting with a staff member concerning the project, and actually working 
through instructional material. During the morning hours when reading instruction is 
provided for the children, the visitor terminal utilizes a special Reading Demonstration 
course which describes the reading program in detail. Special sectionst of the 
mathematics materials are available to visitors during the afternoon hours when 
mathematics instruction is offered. 

Drill - and - Practice Program . Approximately 260 visitors visited the drill-and- 
practice program at local schools by special appointment. They were given an opportunity 
to observe the students at the terminals, to talk to a staff member about the program and, 
in many cases, to work at a terminal on a demonstration lesson. 

Groups of visitors numbered from two to four persons, although larger groups were 
scheduled on occasion. Educators, students and business executives from this country 
and abroad; comprise individuals interested in the project. 

Aspects of the program discussed on the tours were curriculum and its development; 
the computer system, including both hardware and software; the reaction and involvement 
of the children, teachers, and administration. Visitors were also given descriptive 
literature concerning the project. 



Elementary Russian Program . Forty- five to 50 persons visited the computer-based 
first-year Russian classroom at Stanford. Interest centered around the procedure for 
teaching the course and the cost of initiating and maintaining this program. All the 
visitors observed students working at the terminals and most of the visitors took the 
first lesson of the course. Time allotted for an average visit is 45 minutes. 



